Hotspot Components for Gesture-Based Interaction
نویسندگان
چکیده
We present a novel camera-based adaptable user interface system that uses hotspot components for 2D gesture-based interaction. A camera points to the desktop and the image captured by the camera appears on the user’s screen. A hotspot area is activated when a user’s hand passes through the rectangle that defines it. For example, a right_left hotspot activates when the user moves his hand from right to left, entering and exiting the rectangle. Our system is highly flexible because it allows the user to customize the interface as follows: (1) hotspot areas can be created anywhere within the camera-captured image; (2) new commands can be assigned to particular hotspots or composite hotspot sequences (e.g., right_left for previous webpage; up+right+down for webpage reload); (3) a physical workspace on the desktop can be defined by pointing the camera to any location; (4) different hotspot layouts for different applications can be created and saved. The system works with an inexpensive webcam in real time and uses machine learning to automatically detect skin areas for robust gesture recognition.
منابع مشابه
Human Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملResearch and Application of Human-Computer Interaction System Based on Gesture Recognition Technology
With the gradual improvement of the computer performance and the use of computer more deeply in many fields,mouse and keyboard, the traditional human-computer interactive way,show more and more limitations. In recent years,gesture recognition interaction based on machine vision is used more and more widely due to its simple,nature,intuitive and non-contact advantages, which is becoming the rese...
متن کاملThe Face in Activity Analysis and Gesture Interfaces
In this paper we discuss two systems we have developed and raise research questions on the role of the face in their implementation for different scenarios. The first system allows a user to define hotspot templates for gesture-based interaction. A camera points at any space, in which the user can define configurations of 2D hotspot rectangles to define 2D gestures. The rectangles respond only ...
متن کامل